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Abstract 

We consider a type of Markov property for set-indexed processes which 
is satisfied by all processes with independent increments and which allows 
us to introduce a transition system theory leading to the construction of 
the process. A set-indexed generator is defined such that it completely 
characterizes the distribution of the process. 
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1 Introduction 

The Markov property is without doubt one of the most appealing notions that 
exists in the classical theory of stochastic processes and many processes mod- 
elling physical phenomena enjoy it. Attempts have been made to generalize this 
concept to processes where the index set is not totally ordered. 

However, to define a Markov property for processes indexed by an uncount- 
able partially ordered set is not a straightforward task for someone who has 
as declared goals to prove that: (i) all processes with independent increments 
possess this property; (ii) there exists a systematic procedure which allows us to 
construct a general process which enjoys this property; and (iii) we can define a 
generator which completely characterizes the finite dimensional distributions of 
the process. (The case of Markov processes indexed by discrete partially ordered 
sets was considered by various authors [6], [13] for solving stochastic optimal 
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control problems; as our framework is different, we will not discuss this case 
here.) In the present paper we will define a new type of Markov property for 
processes indexed by a semilattice of sets, which will attain these three goals. 

This paper represents a successful manner of approaching a problem to which 
much effort has been dedicated in the literature to date. In fact it will be 
seen that our definition is completely analogous to the classical definition of 
the Markov property on R, and our approach avoids many of the technical 
problems which arise with other definitions of Markov properties. We begin 
now to describe the two levels of generality of this problem. 

The first level deals with the case when the index set is the Euclidean space 
[0, 1]^ (or, more generally [0, 1]*^) and therefore it inherits the extra structure 
introduced by the total ordering of the coordinate axes. In this case, there are 
at least three types of Markov properties which can be considered: the sharp 
Markov property, the germ Markov property, and the 'simultaneously vertical 
and horizontal' Markov property. 

The basic idea behind the sharp Markov property (first introduced in 1948 
by Levy [14]) was to consider as the history of the process at location z in 
the plane or space, all the information that we have about the values of the 
process inside the rectangle [0, z] ; all the information about the values of the 
process outside the rectangle was regarded as 'future'; and the past and the 
future should be independent given the values of the process on the boundary 
of the rectangle. In 1984, Russo [19] proved that all processes with independent 
increments are sharp Markov with respect to all finite unions of rectangles. The 
next step was to see if we can replace the rectangles with more general sets; 
in other words a two-parameter process {Xz)z^[o,i]2 is said to have the sharp 
Markov property with respect to a set A if the a- fields J-a and .F^c are 
conditionally independent given J-qa where J-o = <y{Xz\z G D) for any set 
D C [0,1]^. The advantage of this definition is that it does not rely on the 
partial order of the space. Unfortunately, it turned out that processes having 
this property are difficult to handle. To attain goal (i) the following question 
had to be answered: what is the largest class of sets for which all processes 
with independent increments are sharp Markov? (To answer this question the 
Gaussian and the jump parts have been treated separately.) Goals (ii) and (iii) 
do not seem to be even specified anywhere in the literature. 

(In 1976 Walsh [20] showed that the Brownian sheet fails to have the sharp 
Markov property with respect to a very simple set, the triangle with vertices 
(0,0), (0,1) and (1,0). This led to the conclusion that, instead of the sharp 
cr-field J-QA one has to consider a larger one, called the germ cr-field, which is 
defined as Qqa — ^g^g where the intersection is taken over all open sets G con- 
taining dA. The new Markov property, for which J- a and arc conditionally 
independent given QoAi was called the germ Markov property and it was 
first introduced by McKean [16]. In 1980 Nualart [17] showed that the Brownian 
sheet satisfies the germ Markov property with respect to all open sets.) 

The complete answer was given in 1992 in the form of two thorough papers 
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written by Dalang and Walsh: in [8] it is shown that the Brownian sheet satisfies 
the sharp Markov property with respect to all domains whose boundaries are 
singular curves of bounded variation; on the other hand, the main result of 
[7] states that for jump proceses with independent increments which have only 
positive jumps, the sharp Markov property holds with respect to all domains. 

The third Markov property defined for two-parameter processes was intro- 
duced in 1979 by Nualart and Sanz [18] and it was first studied in the Gaussian 
case. Korezlioglu, Lefort and Mazziotto [12] generalized it and proved that any 
process satisfying this property is sharp Markov with respect to any finite union 
of rectangles and germ Markov with respect to any relatively convex domain. 
The basic idea in this third Markov property is the separation of parameters, 
that is, the simultaneous definition of a horizontal and vertical Markov property. 
It is an easy exercise to show that any process with independent increments satis- 
fies this property. The general construction of a process satisfying this property, 
which corresponds to a certain transition semigroup, was made by Mazziotto 
[15] (the trajectories of this process have also nice regularity properties). 

The second level of generality deals with the case of processes indexed by 
a collection A of closed connected subsets of a compact space. The collection 
A is partially ordered by set-inclusion and has the additional structure of a 
semilattice, being closed under arbitrary intersections. This new approach in 
the modern theory of stochastic processes indexed by partially ordered sets 
(which is known in the literature as the theory of set-indexed processes) was 
initiated and developed by Ivanoff and Merzbach for the martingale case [11]. 
(Other authors [1],[5] were interested in processes indexed by Borel subsets of 
[0, 1]'', but the approach taken by Ivanoff and Merzbach introduces tools which 
permit the development of a general theory.) If we identify this class with the 
class of the rectangles [0,2:], z G [0,1]'' and we denote by Xz the value of the 
set-indexed process at the rectangle [0, z], then {Xz)z will be a d-dimensional 
process; hence, we can view this theory as a generalization of the theory of 
multiparameter processes. 

In [10] both sharp Markov and ('simultaneously vertical and horizontal') 
Markov properties have been introduced in the set-indexed framework, in such 
a manner that they generalize the corresponding notions defined in the multipa- 
rameter case. In fact, in this new set-up, the Markov property implies the sharp 
Markov property and there are certain circumstances when they are actually 
equivalent. Moreover, a highly non-trivial result of [10] shows that all processes 
with independent increments are Markov (in the specified sense), so that goal 

(i) is attained; however, the authors of [10] do not consider goals (ii) and (iii) 
and they do not attempt to construct a general Markov process. 

In this paper we will consider another type of Markov property for set- 
indexed processes, which is less general than the Markov property introduced 
by Ivanoff and Merzbach, but which has the merit of attaining the three goals (i), 

(ii) and (iii). This Markov property will be called the set-Markov property 
and we will show that it implies the sharp Markov property. The definition 
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requires that the value X^\^g = Xaub — Xb of an additive set-indexed process 
{Xa)asA over the increment A\B be conditionally independent of the history 
J^B ■= ^{{Xa']A' ^ A,A' C B}) given the present status Xb- We believe that 
this is a natural definition because: 

(a) it captures the essence of the Markov property in terms of the increments, 

allowing us to have a perfect analogy with the classical case; 

(b) all processes with independent increments are (trivially) set-Markov; 

(c) a process is set-Markov if and only if it becomes Markov in the classical 

sense when it is transported by a 'flow'. (A 'flow' is an increasing function 
mapping a bounded interval of the real line into the collection of all finite 
unions of sets in A.) This property provides us with the means to define 
a generator for a set-Markov process. 

The paper is organized as follows: 

In Section 2 we define the general framework which is used in the theory of 
set-indexed processes. The main structure that we need is a semilattice of sets 
which leads us to a semialgebra and an algebra of sets. All the processes that 
we consider arc assumed to be a.s. finitely additive on this algebra. 

In Section 3 we define the set-Markov property in terms of the increments of 
the process. We will prove that this property has two equivalent formulations. 
The first one (Proposition 1) requires that the 'future' behaviour of the process 
at a set i?'(3 B) be conditionally independent of its history J^b knowing its 
present status at the set B. The second formulation (Proposition 2) requires 
that the (one-parameter) processes X^ obtained as 'traces' of the original set- 
indexed process X along the paths of all flows / be Markov in the classical sense; 
this allows us to make use of the rich theory that exists for Markov processes 
indexed by the real line. 

In Section 4 we turn to the question of existence of a set-Markov process 
and we prove that we can construct such a process if we specify the laws Qbb' 
that characterize the transition from a set _B to a set i?'(I3 B). A set-Markov 
process with a given transition system Q := {Qbb')bcb' is called 'Q- Markov' 
and can be constructed as soon as we specify its finite dimensional distributions 
(by Kolmogorov's existence theorem). However, the formula that we obtain for 
the finite dimensional distribution over some fc-tuple Ai, . . . ,Ak of sets turns 
out to be dependent on the ordering of the sets; hence we have to impose a nat- 
ural consistency condition (Assumption 1) which makes the finite dimensional 
distribution 'invariant' under permutations. An important consequence of this 
condition is that the finite dimensional distributions of a Q-Markov process are 
also additive (Lemma 5). 

In Section 5 we define the generator of a Q-Markov process X as the class 
{Q^', f € S}, where is the generator of the (one-parameter) Markov process 
X^ and 5 is a large enough (uncountable) collection of flows. In other words, at 
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any set B there are infinitely many generators depending on which 'direction' 
we approach this set along the path of a flow / in <S (note that in the classical 
case, the class S of flows can be taken to have a single element). 

In this section we address the question of existence of a Q-Markov process 
given its generator. More precisely, we start with a collection {Q^; f e S}, each 
Q-l^ being the generator of a given semigroup . To simplify the problem we will 
assume that each T-f is the semigroup asociated to a transition system . The 
consistency conditions that have to be imposed on the collection {Q^\f € 5} 
so that it leads to a set-indexed transition system Q (and hence to a Q-Markov 
process) are given in Section 4 (Assumptions 2 and 3). Using an integral form 
of the Kolomogorov- Feller equations, we prove that these conditions can be 
expressed equivalently in terms of the generators and the semigroups 
( We conjecture that the same formulas will he valid in the general case when 
there is no transition system Qf associated to the semigroup .) 

Throughout, we shall illustrate our results with three examples of set-Markov 
processes: processes with independent increments, the empirical process, and 
the Dirichlet process. 

Wc note in passing that set-Markov processes satisfy a type of strong Markov 
property which is studied in a separate paper [2]. 

2 The Set-Indexed Framework 

This section introduces the general definitions, properties and assumptions that 
are used in the theory of set- indexed processes, as presented in [11]. We will 
also give several examples, in addition to the multiparameter case. 

Let ^ be a semilattice of closed subsets of a compact Hausdorff topological 
space T (i.e. A is closed under arbitrary intersections), which contains the empty 
set and the space T itself, but does not contain disjoint (non-empty) sets. In 
addition, we assume that the collection A is separable from above, in the 
sense that any set A G ^ can be approximated from above as 

A = n„ff„(A); Qn+M) C 9n{A), A C g^{Af Vn 

where the approximation set gn{A) can be written as a finite union of sets that 
lie in a finite sub-semilattice ^„ of moreover, ^„ C An+i Vn and g„ preserves 
arbitrary intersections and finite unions i.e. Qni'^aeAAa) = ^aei'^gni^a) ^ VAq, 
e A; and U^iA, = VJf^^A'. ^ V^^^^^gn{A^) = Uf=i5„(A;.), ^Ai,A'. e A. By 
convention, (7„(0) = 0. 

There are many examples of classes of sets which have these properties. 

Examples 1. 

1. T= [0, l]'', ^ = {[0, z]; z e T} U {0}. 

2. T = [0, 1]'', A = {A;Aa compact lower layer in T} U {0}. {A is a lower 
layer if ^ e A [0, 2;] C A) 
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3. T = [a,b]'^,a< < b, A = {[0, z]; z e T} U {0}. 

4. T = [a, b]"^, a<0<b,A={A;Aa. compact lower layer in T} U {0}. 

5. T = B{0,to) (compact ball in R^), A = {AR^t;R ■= '[a,b] x [c,d]',0 < 
a <b < 277, —IT < c < d < TT,t € [0, to]}, where the set 

^R,t '■= {{r COS 6 COST, r sin 9 COST, r sin t); 6 £ [a,b],T G [c,d],r £ [0,t]} 

can be interpreted as the history of the region 

R := '[a, 6] x [c,d\' = {(cos^cosr, sin ^ cost, sin r); ^ G [a,''],T G [c,rf]} 

of the Earth from the beginning until time t. (Here represents the 
longitude of the generic point in the region R, while t is the latitude.) 
Hence, A can be identified with the history of the world until time to- 

Let 0' := ^AeA\{<S}^ minimal set in A (0' ^ 0). The role played by 

0' will be similar to the role played by in the classical theory. 
We will consider the following c;lasscs of sets generated by A: 

• A{u) is the class of all finite unions of sets in A 

• C is the class of all sets of the form C = A\B with A G A,B G A{u) 

• C{u) is the class of all finite unions of sets in C 

Note that A{u) is closed under finite intersections or finite unions, C is a 
semialgebra and C{u) is the algebra generated by C. The value Xc = Xaub—Xb 
of an (additive) set-indexed process {XA.)AeA over the set C = A\B = (^ U 
B)\B will play the role of the increment Xf — Xs,s < t of a one-dimensional 
process {Xt)te[o,a]- 

Any set B G A{u) admits at least one extremal representation of the 

form B = U"^iAi,Ai G A with Ai % ^j^iAj Vi For a set C G C we will 
say that the representation C = A\B is extremal if the representation of B is 
extremal. 

Since the finite sub-scmilatticcs of the indexing collection A play a very 
important role in the theory of set-indexed processes, having an appropriate 
ordering on the sets of a finite sub-semilattice proves to be a very useful tool 
in handling these objects. The ordering that we have in mind will be defined 
in such a manner that a set is never numbered before any of its subsets. We 
will call such an ordering consistent (with the strong past). More precisely, 
if A' is a finite sub-semilattice of A we set Aq := 0' and Ai := DaeA'^ (note 
that the sets Aq and Ai are not necessarily distinct). Proceeding inductively, 
assuming that the distinct sets Ai,. . . ,Ai G A' have already been counted, 
choose Ai+i G A'\{Ai . . . , Ai} such that if there exists a set A G A' with 
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A C Ai+i,A ^ Aj+i then A = Aj for some j < i. It is clear that such an 
ordering always exists although in general, it is not unique. 

If {^0 = ^1, ■ • ■ , ^n} is a consistent ordering of a finite sub-scmilattice 
A', the set Cj = Ai\ U^Cq Aj G C is called the left neighbourhood of the set 
Ai (we make the convention that the left neighbourhood of Aq = 0' is itself). 
The definition of the left neighbourhood does not depend on the ordering since 
one can show that Ci = Ai\{\JAeA',Ai'gAA)- 

Comments 1. 

1. If Bi, . . . ,Bm € A{u) are such that Bi C ••• C B^ then there ex- 
ists a finite sub-semilattice A' of A and a consistent ordering {Aq = 
0', Ai, . . . , An} of A' such that Bi = LIJ^qAj, for some < ii < . . . < 

— ^■ 

2. If A', A" are two finite sub-scmilattices of A such that A' C A", there 
exists a consistent ordering {Aq = 0', Ai, . . . , An} of A" such that if A' = 
{A,„ = 0', A,, , . . . , Ai^} with = io < ii < ■■■ < im, then U^^iAi^ = 
Uj^iAj for any I = 1, . . . ,m. 

Let us consider now a complete probability space {^l,J-,P) and let X := 
be an R-valued process defined on this space, indexed by the class A. 

Wc say that the process X has an (almost surely) unique additive 
extension to A{u) if whenever the set B G A{u) can be written as B = 
Uf^-i^Ai = Uf^^A'j with Ai,...,An,A[,...,A'^€Awe have 

n 

y^^^Aj - ^ XAi^nAi^ H h (-l)'^"^^X^^n...nA^ = 

i=l l<ii<i2<?i 
m 

VX^'. - V Xa' nA' +■■■ + {-ir+'XA'^n...nA'^ a.s. 

Z — / J Z — / Jl J2 1 m 

j=l l<ji<j2<m 

In this case, outside a set of measure 0, we can define Xb as being either one of 
the members of the above almost sure equality. In order to verify that a process 
has a unique additive extension to A{u) it is enough to prove the previous almost 
sure equality only in the case when n = 1. The general case will follow since if 
ur=i-4j = UjL-i^A'j, then each of the sets Ai^ nA^^Ci. . .flAi^ G A can be written 
as the union U™,i(Ajj n Ai^ D . . . Ci Ai^ n A'j). 

Similarly, the process X is said to have an (almost surely) unique 
additive extension to C if whenever the set C G C can be written as 
C = A\B = A'\B' with A,A' eA and B, B' G A{u) we have 

Xa — XAr\B = Xa' - Xa'ciB' a.s. 
The additive extension to C{u) is defined in the obvious manner. 
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A set-indexed process X := {XA)AeA with a unique additive extension to 
C{u) , for which , Xc^ are independent whenever the sets Ci , . . . , C„ G C 

arc disjoint, is called a process with independent increments. 

An example of a process which has a unique additive extension to C{u) is 
the empirical process of size n, corresponding to a probability measure F on 
T, defined by X^ ■= X]j=i -^{z,eA}j ^ G -^7 where {Zj)j>i are i.i.d. T-valued 
random variables with common distribution F. 

Another example is the Dirichlet process with parameter measure a, 
where a is a finite positive measure on (t{ A) (sec Ferguson [9]). This process is in 
fact almost surely countably additive on a{A) and takes values in [0, 1]; moreover 
Xt = 1 a.s. Its finite dimensional distribution of this process over any disjoint 
sets Ai, . . . ,Ak with Ai S (7{A) is the (non-singular) Dirichlet distribution with 
parameters {a{Ai), . . . ,a{Ak); a{{L}'l^iAiy)) (see Ferguson [9]). 

In what follows we will examine the information structure that can be asso- 
ciated with a set-indexed process. 

A collection {J^a)a£A of sub-cr-fields of is called a filtration if J^a C J^a' 
whenever A,A'eA,AC A'. We will consider only complete filtrations. An 
^-indexed filtration {TA)AeA can be extended to a filtration indexed by A{u) 
by defining for each B e A{u), 

Tb:= V (1) 

A^A.A'ZB 

A set-indexed process X is adapted with respect to the filtration {Ta)a^a 
if Xa is Ta -measurable for any A G A. If X is adapted and has a unique 
additive extension to A(u) then Xb is .T^B-nicasurablc for any B e A(u). Given 
a set-indexed process X, the minimal filtration with respect to which X is 
adapted is given by Tb '■= f ({X^; A G A,A C B}). 

Any map / : [0, a] A{u) which is increasing with respect to the partial 
order induced by the set-inclusion is called a flow. 

Deflnition 1. A flow f : [0, a] A{u) is 

a) continuous if for any t € [0, a] and for any decreasing sequence {t„)„ with 

lim„^oo ira = t we have f{t) — Hnfitn), and for a ny increasing sequence 
{t„)n with lim„^ooin =t we have f{t) = U„/(t„). 

b) simple if it is continuous and there exists a partition = to < ti < . . . < 

tn = a and flows fij^i : [t^, ti+i] ^ A. i = 0, . . . n — 1 such thai /(O) = 0' 
and f{t) = Uj^ifj{tj) U fi+i{t),t e [tt,ti+i],i = 0, ...,n- 1. (In other 
words, a simple flow is piecewise A-valued.) 

If A is a finite sub-semilattice and ord= {0' = Aq, Ai, . . . , An} is a consistent 
ordering of A', we say that a simple fiow / connects the sets of the semilat- 
tice A', in the sense of the ordering ord, if f{t) = Wj^iAjU fi+i{t), t G \ti, fj+i], 
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where to = < ti < . . . < t„ = a is a partition of the domain of definition of 
/ and fi+i : [ti,ti+i] —>■ A are continuous flows with fi+i{ti) = Ai, = 
Ai+i. 

Lemma 1. (Lemma 5.1.7, [11]) For every finite sub-semilattice A' and for 
each consistent ordering ord of A! , there exists a simple flow f which connects 
the sets of the semilattice A' , in the sense of the ordering ord. 

Comment 2. A consequence of the previous lemma is the foUowing: given 
Bi,. . . , Bjn e A{u) such that i?i C . . . C there exists a simple flow / and 
ti < . . . < tjn such that Bi = f{ti);i = 1, . . . , to. 

3 Set-Markov Processes 

In this section we will introduce the definition of the set-Markov property. Two 
immediate consequences of the definition will be: (a) any process with indepen- 
dent increments is set-Markov; and (b) the set-Markov property is equivalent 
to the classical Markov property on every flow. Finally we will prove that any 
set-Markov process is also sharp Markov. 

If Q, Ti. are three sub-cr-fields of the same probabilistic space, we will use 
the notation J- LTi \ Q \i J- and H. arc conditionally independent given Q. 

Definition 2. Let X := {XAjAeA be- <^ set-indexed process with a unique 
additive extension to C{u) and, {J'AjAeA Us minimal filtration. We say that the 
process X is set-Markov ifWA e A, MB & A{u), Tb ^ a{X \ u{Xb). 

It is easy to see that in the classical case the set-Markov property is equivalent 
to the usual Markov property. 

Examples 2. 

1. Any process X := {Xa)a&a with independent increments is set-Markov 
since VA e A, MB e A{u), X^\^g is independent of J^b- 

2. The empirical process of size n (corresponding to F) is set-Markov since 
MA e A, MB e A{u), for any partition B = ^l^-^Ci,Ci € C and for any 
l,ki, ... ,kp & {0,1, ■■■ , n}; k J2^=i ^i^h k -\- 1 < n 

P[Xa\b = ^I^^. = ^'^ = 1' • • • = Pi^A\B = i\XB = ^] 

both sides being equal to the value at I of the binomial distribution with 
n — k trials and "fl^'^gj probability of success. 

3. The Dirichlet process X := {XA)Aecr{A) with parameter measure a is set- 
Markov since e A, MB G A{u), for any partition B = U''^^^Ci,Ci € C 
and for any y,xi, . . . ,Xp e [0, 1]; a; := Yl^^i Xi with x-\-y <1 

P[Xa\b < y\^c, =Xi;i = l,...,p]= < y\XB = x] 
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both sides being equal to the value at of the Beta distribution with 
parameters {a{A\By,a{{A[J B)")) (we use property 7.7.3, p. 180, [21] of 
the Dirichlet distribution). 

We shall make repeated use of the following elementary result. 

Lemma 2. Let Q' C Q be two a-fields in the same probability space and 
X, Y two random vectors on this space such that Y is G -measurable. Suppose 
that E[f{X)\Q] = E[f{X)\Q'] for every bounded measurable function f . Then 
E[h{X,Y)\Q] = E[h{X,Y)\Q' ,Y] for every bounded measurable function h. 

Proposition 1. Let X := {XA)AeA be a set-indexed process with a unique 
additive extension to C{u) and {J-A)AeA its minimal filtration. The process X 
is set-Markov if and only if\/B,B' G A{u),B C B' , Tb -L o^Xb') \ (j{Xb). 

Proof: Using Lemma 2 and the additivity of the process, it follows that X 

is set-Markov if and only if G VS G A{u), Tb -L (t(Xaub) | cr(^B)- 
(Write Xa\jb = ^a\b + ^^"^ ^^'^^ ^s-measurable.) Let 

B,B' € A{u) be such that B C B'. Say B' = ujLi^j, A, G ^ is an arbitrary 
representation. Then B' = B L) B' = B L) U^^^^j and the result follows by 
induction on fc. □ 

Comment 3. Using Proposition 1 and Lemma 2, we can say that a process 
X := {XA)AeA is set-Markov if and only if VB,B' G A{u),B C B', Tb -L 
<j{X^,s^^) I a{XB). 

The following result says that a process is set-Markov if and only if it is 
Markov (in the usual sense) along any flow. Moreover, it suffices to restrict our 
attention only to simple flows. 

Proposition 2. Let X := {XA)AeA f>6 a set-indexed process with a unique 

additive extension to C{u) and {TA)AeA Us minimal filtration. Then X is set- 
Markov if and only if for every simple flow f : [0, a] A{u) the process Xf := 
(X^(t))tg[o,a] is Markov with respect to the filtration (^/(t))te[o,a] • (For necessity, 
we can consider any flow, not only the simple ones.) 

Proof: The process X^ is Markov with respect to the filtration {Tf(^t))t if 
and only if Vs,f G [0,a],s < t,Tf(^s) -L ^i^fit)) I '^{^f(s))- (We note that 
the filtration {Tf(t))te[o,a] is not the minimal filtration associated to the process 
X^ .) This is equivalent to the set-Markov property since we know that whenever 
the sets B, B' G A{u) are such that B C B' there exists a simple flow / and 
some s <t such that f{s) = B and f{t) = B' (Comment 2). □ 

The preceding proposition, while simple, is crucial since (as noted in the 
Introduction) it provides us with the means to define the generator of a set- 
Markov process. This will be done in Section 5. 

We now show that every set-Markov process satisfies the sharp-Markov prop- 
erty defined in [10]. In analogy with the minimal filtration {Tb) BeA{u) we define 
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the following a-fields, for an arbitrary set B e A{u): 
TdB := a{{XA; AeA,ACB,A^ 
J^Bc ■.= a{{XA;AeA,A^B}) 

Definition 3. Let X {Xa)agA o, set-indexed process with a unique 
additive extension to C(u) and {J-^A)AeA Us minimal filtration. We say that the 
process X is sharp- Markov ifVB e A{u), J^b -L \ J^as- 

The next lemma will be essential in proving that a set-Markov process is 
sharp Markov. 

Lemma 3. If X := {XA)AeA is a set-Markov process, then\/B € A{u) VAi 
€ A;i = l,...,n, ± a{X^^\g, . . .,X^^\g) \ aiXs)- 

Proof: Let B G A{u),Ai, . . .An £ A and h : R" — > R an arbitrary bounded 
measurable function. Without loss of generality we can assume that Ai % B \/i; 
say B =- U^„^]^Aj, Aj € A. Let A' be the smallest finite sub-scmilattice 
which contains Ai, . . . A^, {A'q = 0', A'^, . . . , A'^} a consistent ordering of A', 
and C- the left neighborhood of A'^ in A'. Say Aj = A[, for j = 1 . . . n; then 
Aj\B = A[\B = Uiei^C^ with I, C {1, . . . and X^^{^ = Eie,^. Xq- 

Therefore we can say that h{X^^\^g, . . . , X^ — hi{Xc>^ , ■ ■ ■ , Xc'^ ), for 
a certain bounded measurable function hi and some li < ... < ls,C'i, % B. 
In order to simplify the notation, let us denote Di := Cl,i = l,...,s. Let 
B, = B\J U|^i_Dfc for i = 1, . . . , s. Then A = B^\B,^i and Xd, = Xb, - 
XBi_i', hence X^i, ■ ■ ■ ,^d^-i are J^Bi _^ -measurable. Because each Di is the 
left neighbourhood of A'l., we also have Bi = BL) U^^^AJ^ and therefore Dj = 
{A'l, USj_i)\i?i_i = A'i\Bi-i. Using the equivalent definition of the set-Markov 
property given by Comment 3, we have E[f{XDj\J^Bs-i] = E[f{XD,)\XB,_i] 
for any bounded measurable function /. Now we are in the position to apply 
Lemma 2 to get 

E[hi{XDi,- ■ ■ ,XdJ\J^b,-i] = E[hi{XDi,- ■ . ,XdJ\Xb,_i,Xdi, ■ ■ ■,Xd^_-^]. 

Hence E[h{X^^\^,. . . ,X^ \j^)\J^b] = E[E[hi{XD„ . ■ . ,XDj\J'B,_,n] = 
E[E[hi{XD,,. ■ .,XDj\XBi„XD„. ■ ■,Xd^_,]\J^b]- Writing Xb,_, = Xb + 
EfclU^. we get E[h{X^^\^,...,X^^s^^)\J^B]=E[h2{Xn„...,Xn^_„XB)\ 
J^b\- Continuing in the same manner, reducing at each step another set Di, we 
finally get i;[/i(X^^\^,...,X^^\^)|^B] =^[M^^,\b'---'^a„\s)I^b]. □ 

Proposition 3. Any set-Markov process is sharp Markov. 

Proof: Let B e A{u), Ai A, Ai <^ B;i = 1, . . . ,n and h : R" ^ R an arbi- 
trary bounded measurable function. Writing Xa^ = Xa^hb + X^ ^^ and using 
Lemma 2 we can say that E[h{XAi, . . ■ ,Xa„)\Tb\ = E[h{XAi, . ■ • ,XAr,)\XB, 
XAinB,i = 1, . • .n], which is .Fas-measurable, by Lemma 2.4, [10]. □ 
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In what follows we will give an important characterization of the set-Markov 
processes that will be instrumental for the construction of these processes. 
We will need the following elementary result. 

Lemma 4. Let = 1, . . . , 4 be four a- fields in the same probability space. 

If T\ ^ I T2 and T\\l T2 ^ \ T^, then T\ ^ J-^ \ J-2 . 

Proposition 4. A set-indexed process X := {XA)AeA with a unique additive 
extension to C{u), is set-Markov if and only if for every finite sub-semilattice 
A' and for every consistent ordering {Aq = 0', j4i, . . . , of A' 

a{XAa , XaouAi ^uizlAj ) -L <^(^u'±i A,- ) I^^C^u'^^A,- ) Vi = 1, . . . , n - 1 (2) 

Proof: We will use the characterization of the set-Markov property given by 
Proposition 1. Necessity follows immediately. 

For sufficiency note first that equation (2) implies a similar equation where 
the union of the first i + 1 sets is replaced by the union of the first i + p sets. 
In fact it is easily shown by induction on p and using Lemma 4, that 

a{XAo,XAoUAl,...,X^J^^-l^^) _L a{X^j^+k^^:k = 1, . . . ,p)\a{X^j^^^A,) Vi (3) 

Consider now arbitrary sets B,B' G A{u) with B C B' . By a monotone 
class argument it is enough to show that V^; e A,A'i C B;l = l,...,m, 
a{XA'^, ■ ■ ■ T Xa'^) -L ct(Xb/)|(j(Xb). Without loss of generality wo may as- 
sume that {A'q = W,A[, . . . ,A'^} is a finite sub-semilattice and that the or- 
dering {Aq = W , A[, . . . , A'^} is consistent. Because the process X has a 
unique additive extension to A{u), there exists a bijective map -0 such that 
{Xa[ , Xa'^ , . . . , Xa'^^ ) = ij{XA[ : XA'^yjA'^ , ■ • ■ , Xii^^^A[ ) a.s.. Consequently, we 
have a{XA'^ , Xa[^ , • • • , Xa'^ ) = cr{XA'^ , Xa'^uA'^ , • • • , -'^u^^a; )• 

By Comment 1.1, there exists a finite sub-semilatticc A' of A and a con- 
sistent ordering {Aq = 0', ^1, . . . , of A', such that A[ = U'jLqAj,A[ U 

A'^ = U%„A,,...,UYUA'i = ^^o^j,B = IJ%VA„B' = ij]ri+^A, for some 
*i !i *2 !i ■ • • !i im+2- Using (3), it follows that (t{Xa'^, Xa>^uA!^i ■ ■ ■ )-^u™LjAJ 
a{XB'MXB). □ 

4 Construction of the Process 

In this section we will introduce a special class of set-Markov processes for which 
the mechanism of transition from one state to another is completely known, and 
we will construct such a process. In light of Proposition 2, we will also determine 
the necessary and sufficient conditions that have to be imposed on a family 
of one-dimensional transition systems, indexed by a collection of simple flows, 
such that on each simple flow / from the chosen collection, the corresponding 
Markov process has the law of X^, where X is set-Markov (i.e., under what 
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circumstances a class of one dimensional transition systems determines a set- 
Markov process). 

Let ,B(R) denote the Borel subsets of R. We begin with the definition of the 
transition system. 
Definition 4. 

(a) For each B, B' € A{u), B C B' let Qbb'{x; T), x G R, T e S(R), be a tran- 

sition probability on R i.e., Qbb'{x, ■) is a probability measure Va;, and 
Qbb'(-; r) is measurable VF. The family Q := {Qbb') of all these transi- 
tion probabilities is called a transition system ifiB e A{u), Qbb{x; •) = 
and VS, B', B" e A{u), B C B' C B" 

QBB"{x;r)= [ QB'B"iy;r)QBB'{x;dy)^xeR,yT eBiR) 
Jr 

(b) Let Q := {Qbb')b,b'gA{u);Bcb' be a transition system. A set-indexed pro- 

cess X := {XAjAeA with a unique additive extension to C{u) is called 
Q-Markov if\JB, B' e A{u), B C B' 

P[Xb' e T\J^b] = Qbb'{Xb;T) vr e S(R) 

where {^A)AeA is the minimal filtration of the process X. 

In other words, a Q-Markov process is a set-Markov process for which Qbb' 
is a version of the conditional distribution of Xb' given Xb, for every B,B' G 

A{u),B C B'. 

Examples 3. 

1. Any process X := {Xa)a£A with independent increments is Q-Markov 
with Qbb'{x; T) := Fg,\^g{T — x), where Fc is the distribution of Xc, C S 
C{u). The Poisson process and the Brownian motion are the particular 
cases for which Fc is a Poisson distribution with mean Ac, respectively, 
a normal distribution with mean and variance Ac. 

2. The empirical process of size n, corresponding to a probability measure F, 
is Q-Markov with Qbb'{^; {^}); k,m e {0,1, ... ,n},k < m given by the 

value at m — A; of the binomial distribution with n — k trials and ^^^^^^ 
probability of success. 

3. The Dirichlet process with parameter measure a is Q-Markov with 
Qbb'{x;[0, z]);x, z € [0,1] given by the value at j^f of the Beta dis- 
tribution with parameters {a{B'\B); alB'")). 

The following result gives equivalent characterizations of a Q-Markov process. 
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Proposition 5. Let Q := {QBB')B,B'eA{u);BGB' be a transition system, 
X := {Xa)a^a 0- set-indexed process with a unique additive extension to C{u) 
and initial distribution /i, and {J-'A)AeA the minimal filtration of the process X. 

The following statements are equivalent: 

(a) The process X is Q-Markov. 

(b) For every simple flow f : [0, a] A{u) the process X^ := (-'i'/(f))tg[o,a] 

Qf -Markov (with respect to (^/(t))te[o,a] A where := Qf(s)j'(t)- 

(c) For every finite sub-semilattice A' , for every consistent ordering {Aq = 

0', j4i, . . . , An} of A' and for every i = 1, . . . ,n — 1 

a{XAo,XAi,XAiUA2, ■ ■ ■ ,Xu'-]aJ '^(^U'+]Ai) I (^i^U^.^A,) 

and Q, ,i , . is a version of the conditional distribution of X, . 

given ^uj^^A, • 

(d) For every finite sub-semilattice A' and for every consistent ordering {Aq = 

0',>li,...,A„} of A' 

P{Xao € To, Xai G Ti,XaiuA2 &^2,---, Xuj^^Aj S r„) = 

« n 

/ ^ro(a;o) TT^ri(a;i)(5u"-i^ . u„ ^ . . . . 

Qai,AiuA2 {xi;dx2)Qiii'Ai {xo;dxi)n{dxo) 
for every Tq , Ti , . . . , r„ e B(R) . 

(e) For every finite sub-semilattice A! , for every consistent ordering {Aq = 

%' , Ai, . . . , An} of A! , if we denote with Ci the left neighbourhood of the 
set Ai, then 

P{Xco e To, e Ti, Xc, e r2, . . . , Xc„ e r„) = 

~ n 

/ Iro{xo)Iri{xi)Y\ hiixi - Xi-l)Q^J^-l^ j^,{x„-i;dx„) . . . 

Qai,AiuA2 {xi ; dx2)Q(ij'Ai {xo; dxi)iJ,{dxo) 
for every TQ,Ti,...,Tn € B(R). 

Proof: The equivalences (a)-(b), (a)-(c) follow by arguments similar to those 
used to prove Proposition 2, respectively, Proposition 4. The equivalence (c)-(d) 
follows exactly as in the classical case. Finally, the equivalence (d)-(e) follows 
by a change of variables, since X^ = X^Ji ^a, ~ ^u*~^Aj '-' 
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The general construction of a Q-Markov process will be made using incre- 
ments: i.e., the sets in C. The following assumption is necessary. It requires 

that the distribution of the process over the left- neighbourhoods Co , Ci , . . . , C„ 
of a finite sub-semilattice, does not depend on the consistent ordering of the 
semilattice. 

Assumption 1. If {Aq = 9',Ai,..., A^} and {Aq = $',A[,..., A'^} are 

two consistent orderings of the same finite sub-semilattice A' and it is the per- 
mutation of {1, . . . ,n} with 7r(l) = 1 such that Ai = A'^^^^ Vi, then 

« n 

/ Iro{xo)Iri{xi)\\lri{xi-Xi-i)Q^ 

"~^Ai U" aAXu-I'i dXn) ■ ■ ■ 

QAi,AiuA2{xi;dx2)Qiii'Ai{xo;dxi)iJ.{dxo) = 

n 

^ro(2/o)^ri(2/i) n^r.(2/^(i) - y7r(i)-i)Qu"-M' ,u" A'XVn-Wdyn) ■ ■ ■ 

7 = 1 ?' 7 = 1 1 



/ 



i=2 



QA'^,A'^uA'^{yi\ dy2)Q0'A[{yo; dyi)ii{dyo) 

for every ro,ri, . . . ,r„ e S(R). 

The finite dimensional distributions of a Q-Markov process over the sets in C 
have to be defined so that they ensure the (almost sure) additivity of the process. 
The next result gives the definition of the finite dimensional distribution (of an 
additive Q-Markov process) over an arbitrary fc-tuplc of sets in C and shows 
that, if the transition system Q satisfies Assumption 1, then the definition will 
not depend on the extremal representations of these sets. 

Lemma 5. Let Q := {Qbb')bcb' be a transition system satisfying Assump- 
tion 1. Let (Ci, . . . , Cfe) he a k-tuple of distinct sets in C and suppose that each 
set Ci admits two extremal representations Ci = Ai\ U^li Aij = A'^\ ifjlli A'^j. 
Let A', A" be the minimal finite sub-semilattices of A which contain the sets 
A„Aij, respectively A[,A[j, {Bo - 0', Bi, . . . , B„}, {B'„ ^ , B[, . . . , B'^} two 
consistent orderings of A', A" and Dj,D'i the left neighbourhoods of the sets 
Bj, B[ for j = 1, . . . ,n;l = 1, . . . ,m. If each set Ci;i = 1, . . . ,k can be written 
as Ci = Uj^j.Dj = Ui^LiD'i for some Jj C {1, . . . , n}, Lj C {1, . . . , m}, then 

k 

/ n (XI (^J' " ^J-i))'3u"-iB„u" , B. ixn-i;dx„) . . . 



L 



Qbi,BiuB2 (xi ; dx2)Qiii'Bi {x; dxi)ii{dx) = 

k 

n -^r* (V] (?/; - yi--^))QuTl^B'uT , B'XVm-r, dy„ 

■D m -1-1 • 1 = 1 ( ' ( = 1 t 

^ i=l leLi 
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for every Fi, . . . , £ 13{JiVj, with the convention xq = uq = 0. 

Proof: Let A be the minimal finite sub-semilattice of A determined by the sets 
in A' and A"; clearly A' C A, A" C A. Let ord^ = {£^0 = 0', ^^i, • • • , En} and 
ord^ = {Eq = <l)',E[,... ,E'j^} be two consistent orderings of A such that, if 
Bj = Ei- ; j = 1, . . . , n and B'^ = E'^,^ ; / = 1, . . . , m for some indices it < 12 < 
. . . < in, respectively ki < k2 < ■ . ■ < km, then 

Bi = ^iUEp, Si u B2 = u;LiSp, • • • , u;=i-B, = ui^^^Ep 
B[ = u^Li4, Si u = u^Li4, ■ • ■ ' ul^i^^' = 

Let TT be the permutation of {1, ... , N} such that Ep = E'^i^^y,p = 1, . . . , N. 
Denote by Hp,H'^ the left neighbourhoods of Ep,E'g with respect to the or- 
derings ord^,ord^; clearly Hp = H'^^^y \/p = 1,...,N. Note that Dj = 

{ui^,B,)\{uC\B,) = {U^.EpUu'^ZlEp) = u;t,._^+iFp;i = l,...,n and 
similarly D'l = u'^Lj^^_^_^_iH'g; I = 1, . . . ,m. Hence 

Ci = ^j&JiDj =yJJ(z.J^\J^^^,_^^^Hp = \JJ(zJ.\J'^^^,_^^^H'^^^p■^ 
= UzeLii?? = UigL. UgLfe,_i+i S^ 
and we can conclude that 

{tt(p);p e \Jj^J^{ij--^ + +2,...,ij}} = Ui^Li{k-i + +2, . 

This implies that 

„ k ij 

/ n^r,(E E (^p -^p-i))<5u^YBp,u« ,Bp(a=JV-i;da;jv)... 

+ i=l jGJi p=ij-i + l 

Qbi,BiUB2 [xi ; dx2)Q$'Ei (2^; dxi)ix{dx) 

P k ki 

= / n^r,(E E (y9-2/9-i))'3u"-i£;',u",i5'(yiv-i;'^2/Jv)... 

{yi;dy2)Q<H'E[{y; dyi)^,{dy) 

with the convention xq = yo = 0. This gives us the desired relationship, because 
Sp=i3_i+i(^p ~ ^P-'^) = — Xi._^, the left-hand side integral collapses to 
an integral with respect to (3|,„ ^ u"-'b (^'n-ii . . . QBi,BiUB2{xn;dxi^) 

Q$' Bi {x; dxi^)fi{dx), and a similar phenomenon happens in the right-hand side. 
□ 
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We are now ready to prove the main result of this section, which says that in 
fact the previous assumption is also sufficient to construct a Q-Markov process. 

Theorem 1. If n is a probability measure on R and Q := {Qbb')bcb' is a 

transition system which satisfies the consistency Assumption 1, then there exists 
a Q-Markov process X {Xa)ai£A with initial distribution fi. 

Proof: Let (R'^,7^'^) := Uceci^c,T^c) where {Rc,'R-c),C € C represent C 
copies of the real space R with its Borcl subsets. For each fc-tuple (Ci, . . . , Cfc) 
of distinct sets in C we will define a probability measure /iCi...Cfc on (R'^,7?,'^) 
such that the system of all these probability measures satisfy the following two 
consistency conditions: 

(CI) If (C( ... C^) is another ordering of the fc-tuple (Ci . . . Cfc), say Ci = (^^(i) ' 
TT is a permutation of {1,. . . ,k}, then 

Mci...c,(ri X ... xrfe) = //c;...c^(r„-i(i) X ... X r„-i(fc)) 

for every Ti, . . . , Tfc e S(R). 
(C2) If Ci, . . . , Ck, Ck+i are k + 1 distinct sets in C, then 

MCi...c,(ri X . . . X Tfc) = MCi...CfeC,+i(ri X . . . X Tfc X R) 
for every Ti, . . . , Tfc e S(R). 

By Kolmogorov's extension theorem there exists a probability measure P 
on (R'',?^'-) such that the coordinate-variable process X := {Xc)ceC defined 
by Xc{x) := xq has the measures fJ,Ci...Ck as its finite dimensional distribu- 
tions. We will prove that the process X has an (almost surely) unique additive 
extension to C{u). The Q-Markov property of this process will follow from 
the way we choose its finite dimensional distributions /iCoCi...c„ over the left 
neighbourhoods of a finite sub-semilattice, according to Proposition 5, (e). 

Step 1 (Construction of the finite dimensional distributions) 
We define jU0 := ^o- Let (Ci, . . . , Cfe) be a fc-tuple of distinct nonempty sets 
in C and Ci = Ai\ U^Li Aij]i — 1,. ..,k some extremal representations. Let 
A! be the minimal finite sub-semilattice of A which contains the sets Ai,Aij, 
{Bo = W , Bi, . . . , Bn} a consistent ordering of A' and Dj the left neighbourhood 
of the set Bj for j = 1, . . . , n. Define 

« n 

MDoUi...r>n (To X Ti X ... X r„) := / Ir^ (a;o)/ri {xi) TT Ir^ (x, - Xi-i) 

^=2 

'5u"-ib u" sixn-udxn) . . ■ Q Bi,BiUB2{xi; dx2)Qg,' Biixol dxi)iJ,{dxo) 

j=l J' j=l J 

for every Tq, Ti, . . . , r„ e S(R). 
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Say Cj = Uj^j^Dj for some Jj C {1, . . . ,n};i = l,...,k, let a : R"'+^ 
K'', a{xo, xi,...,Xn) := (Ejeji xj,..., ^j) and define 

The fact that nci...Ck does not depend on the ordering of the semilattice A' is 
a consequence of Assumption 1. The fact that iic^...Ck does not depend on the 
extremal representations of the sets Ci is also a consequence of Assumption 1, 
using Lemma 5. Finally, we observe that the finite dimensional distributions 
are additive. 

Step 2 (Consistency condition (CI)) 
Let {C[ . . . C'f.) be another ordering of the fc-tuple (Ci . . . C/c), with Cj = C^(j), 
TT being a permutation of {1, . . . , k}. Let Ci = Ai\ U"ij Aij;i = 1, . . . , fc be 
extremal representations, A' the minimal finite sub-semilattice of A which con- 
tains the sets Ai,Aij, {Bq = W , Bi, . . . , Bn} a consistent ordering of A' and 
Dj the left neighbourhood of the set Bj for each j = l,...,n. Say Ci = 
UjeJiDj,Cl = lijerDj and let a{xo, xi,..., Xn) := (EjeJi xj,..., ^o)^ 
P{xo,xi, ...,Xn):= Xj,- . ■,J2jeJ'i^ ^i)- ^^'^^ ^ "^^(i)- Hence 

MCi...Cfc(ri X ... X Tfc) = mr'i...c„(""^(ri X . . . X Tfc)) 

= I^DoDi...dAI3^ (rTr-i(l) X ... X r^-i(^.))) 
= MC(...C^ (r,r-i(l) ^ ■■■ ^ r7r-i(fe)) 

for every Ti, . . . , Tfc e B(R). 

Step 3 (Consistency Condition (C2)) 
Let Ci, . . . , Cfc, Ck+i be fc + 1 distinct sets in C and Ci = Ai\ U"i]^ Aij; i = 
1, . . . , fc + 1 some extremal representations. Let A', A" bo the minimal finite 
sub-semilatticcs of A wliicli contain the sets Ai, Aij; i = 1. . . . .k: j = 1, . . . , n^, 
respectively Ai,Aij;i = l,...,k-\- l;j = l,...,ni. Clearly A' C A". Using 
Comment 1.2 there exists a consistent ordering {Bq = 0',-Bi, • . • ,Bn} of A" 
such that, if A' = {Big = 0', Bi^, . . . , Bi^} with = < ii < . . . < im, then 
Us=iSi, = Dj^^Bj for all / = 1, . . . , m. For each j = 1, . . . , n; / = 1, . . . , m, let 
Dj,Ei be the left neighbourhoods of Bj in A", respectively of Bi^ in A' and 
note that Ei = U*Lij_^_|_i-Dj for each I = l,...,m. Let 7(a;o,a;i, . . . ,a;„) := 

{xo, SjLi ^J' Sj=»i+i • • • ' Sj=i^_i+i Xj) and for the moment suppose that 

IJ'EoEi...E^ = IJ'DoDi...D„ ° (4) 

Say Cj = L\j^j^Dj;i = 1, . . . , fc + 1 for some Ji C {1, . . . , n} and define a(a;o,a;i, 
. . . , Xn) := (X]je 7i ■'J^j. • • • , YljeJk+i ^i^' ^^'^ other hand, if we say that 
for each i = 1, . . . ,k we have Ci = Ui^LiEi for some Lj C {l,...,m}, then 
Ji = Ui6L,{i(_i + l,i;_i + 2, define /3(yo, 2/m) := [T^ieL^Vh 

■■■,Y.ieLkVi)- Then 

A*Ci...Cfe(ri X ... X Ffc) = I^EoEi...Em 

(/3-i(Fi x...xFfc)) 
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= ^^D„D,...DAl~\^'{^l X ... xTfc))) 

= AiDoDi...£)„(a"^(ri X . . . X Tfe X R)) 
= m...c.c.+i(ri X ... X Tfe X R) 

for every Ti, . . . , Tfe e S(R). 

In order to prove (4) let Fq, Fi, . . . , F^ € 'B(R) be arbitrary. Then 



MDor>i...i3„(7 ^(Fo X Fi X . . . X F„)) = 

-froxrix...xr„(7(a;o. 2^1,2^2 - xi, . . . ,x„ - a;„_i)) 



Qu"-'b- u" Bi^n-i;dxn) ■ ■ ■ Qbi,BiUB2{xi; dx2)Q<ii' Bi{xo; dxi)iJ,{dxo) 

j = l 3 ' j = \ 3 

Note that 7(.xo, - . . . , .t„ - .t„_i) = (.To, .t^^ , x,^ - .x^, , . . . , - x^^, J 

and hence the integrand does not depend on the variables Xj,j ^ {iq, ii, . . . , 
By the definition of the transition system, the above integral collapses to 



lTAxo)lT,{Xi,)\\_lT,{Xi, - Xu_,)Q^i^-ij^^^^i^^j^iXi^_^-,dXiJ . . . 



1=2 



n_ rjixo;dx,,)n{dxn) 

which is exactly the definition of fiEoEi...E,„ (Fo xFi x . . .xF„i) because Uj^iBj = 
D^s^iBi^ for every / = 1, . . . , m. This concludes the proof of (4). 

Step 4 (Almost Sure Additivity of the Canonical Process) 
We will show that the canonical process X on the space (Rp,TZ'^) has an (al- 
most surely) unique additive extension to C{u) (with respect to the probability 
measure P given by Kolmogorov's extension theorem) . Let C,Ci, . . . ,Ck £ C be 
such that C = uf^j^Ci, and suppose that Ci — Ai \ U"ij^ Aij; i — 1, . . . ,k are ex- 
tremal representations. Let A' be the minimal finite sub-semilattice of A which 
contains the sets Ai,Aij, {Bq = 0', . . . , -Bn} a consistent ordering of A' and 
Dj the left neighbourhood of Bj. Assume that each Ci = Uj^j.Dj for some 
Jj C {1, . . . , n}. Because the finite dimensional distributions of X were chosen 
in an additive way, we have X^ = J2jeJi a.s., Xd^nd^ = J^jeii^nu^ 
a.s., ... , Xf~,k^^c, = Y.jen'i^ji^D, a.s., Xc = EjGuti^. ^-s. Hence 

Ei=i - T,n<i2 ^Ci^nCi^ +... + {-!)'' X^k^^Ci = Ejeu^i = Xc a.s. 

□ 

Finally we will translate the preceding result in terms of flows. Let fi be an 

arbitrary probability measure on R. 

For each finite sub-semilattice A' and for each consistent ordering ord= 
{Aq = 0', Ai, . . . , An} of A' pick one simple flow / := fA\oid which connects 
the sets of A' in the sense of the ordering ord. Let <S be the collection of all the 
simple flows fA',oid and {Q-^ := {Qit)s<u f G <S} a collection of one-dimensional 
transition systems indexed by <S. 
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The next assumption will provide a necessary and sufficient condition which 
will allow us to reconstruct a set-indexed transition system Q from a class of 
one-dimensional transition systems {Q-^}. It requires that whenever we have two 
simple flows f,g G S such that /(s) = g{u),f{t) = g{v) for some s < t,u < v, 
we must have Q^^ = Q^^. 

Assumption 2. // ordl= {Aq = 0', Ai, . . . , A„} and ord2= {Aq = 0', A[, 

. . . , A'^} are two consistent orderings of some finite semilaitices A', A" such 
that U^=i^j = UjLj^A'j, Uj=iAj = Uj=iA'j for some k < n,l < m, and we 
denote f := /^',ordi, 9 ■= fA",ord2 with f{ti) = U'-^iAj, g{ui) = ^]=iA'^, then 

Qk = QL, and g4,„ = g^,„^ 

The following assumption is easily seen to be equivalent to Assumption 1. 

Assumption 3. If ordl = {Aq = 0', Ai, . . . , An} and ord2 = {Aq = 0', A[, 
. . . , A'n} are two consistent orderings of the same finite semilattice A! with Ai = 
^'nii)' where w is a permutation of {1, ... ,n} with 7r(l) = 1, and we denote 
f ■■= fA',ordi, 9 ■■= fA',ord2 with f{ti) = uj^iAj , g{ui) = uj^iA'j, then 

n 

Iro{xo)IrA^i)'[ilri{xi - Xi-i)Q(^_^f^{xn-i;dxn) ... (5) 

' i=2 

QLt2 (2^1 ; dx2)Qk i^o; dxi)iJ,{dxo) = 

n 

I iTo{yo)ir^{yi)T\iTi{y-;,(i) -y,r(i)-i)<3«„_i«„(yn-i;(^2/n)--- 

J^-+' 7=2 

QuiU2 

for every Tq.Ti, . . . , r„ £ S(R). 

The following result is immediate. 

Corollary 1. If is a probability measure on R and {Q^ := {Q{f)s<t] 
f G S} is a collection of one- dimensional transition systems which satisfies the 

matching Assumption 2 a,nd the consistency Assumption 3, then there exist a 
set-indexed transition system Q := {Qbb')b(ib' and a Q-Markov process X := 
{XA)AeA with initial distribution such that V/ e S, := is - 

Markov. 

Proof: Let B,B' £ A{^i) be such that B C B' . Let S = U^^A^ , B' = Uf^^AJ' 
be some extremal representations, A! the minimal finite sub-semilattice of A 
which contains the sets A'^A'l and ord={Ao = %' ,Ai, . . . ,An\ a consistent 
ordering of A' such that B = U^^^^Aj and B' = Uj^^^j. Denote / := fA',ovd 
with f{ti) = ui^-^Aj. We define Qbb' := Q^tn- 
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The definition of Qbb' does not depend on tlie extremal representations of 
B,B', because of Assumption 2. 

Finally it is not hard to see that the family Q := {Qbb')bcb' is a transition 
system which satisfies Assumption 1. □ 

5 The Generator 

In this section we will make use of flows to introduce the generator of a Q-Markov 
process. Corollary 1 allows us to characterize a Q-Markov process by a class 
{Q'^',/ G S} of one-dimensional transition systems. These transition sytems 
in turn are characterized by their corresponding generators. This observation 
permits us to define a generator for a Q-Markov process as a class of generators 
indexed by a suitable class of flows. The generator completely characterizes 
the distribution of a Q-Markov process. We will also determine necessary and 
sufficient conditions that will ensure that a family of one-dimensional generators, 
indexed by a collection of simple flows, is the generator of a Q-Markov process. 

Let B(R) be the Banach space of all bounded measurable functions /i : R ^ 
R with the supremum norm. 

Let Q := {Qbb')bcb' be a transition system and X := {XA)AeA a Q- 
Markov process with initial distribution fj,. For each finite sub-semilattice A' 
and for each consistent ordering ord= {Aq = ^' , Ai, . . . , An} of A' pick one 
simple flow / := fA',oid which connects the sets of A' in the sense of the ordering 
ord. Let S be the collection of all the simple flows fA',oid- 

For each f G S, let T-f := {Tg^)g^t be the semigroup associated to the transi- 
tion system and C//, Q*J the backward, respectively the forward generator of 
the process at time s, with domains 'D{Ql), V{Q*-f ). We will make the usual 
assumption that all the domains ^{Qf) and 'D{Q*^) have a common subspace 
V, which is dense in i?(R), such that for every s < t, t/j(2?) C 2? and for every 
h GV, the function t/^/i is strongly continuously differentiable with respect to 
s and t with 

The operator = Q*^ deflned on D, will be called the generator of the process 
X^ at time s. A consequence of Kolmogorov-Feller equations is that 

T/,/i -h = I g^Tlh dv, V/i e D (6) 

J s 

Definition 5. The collection {G^ := {g{)s',f £ S}, where Q{ is the genera- 
tor of the one-dimensional process X^ at time s, is called the generator of the 

set-indexed process X. 

Corollary 2. The generator of a Q-Markov process determines its distribu- 
tion. 



A Markov property for set-indexed processes 



22 



Proof: Since determines and , the result is an immediate consequence 
of Corollary 1. □ 

Examples 4. 

1. The generator of a process with independent increments, which is stochas- 
tically continuous and weakly differentiable on every simple flow / e «S, is 
given by 

iQ{h){x) = iiD'h'ix) + ^-{Kiyh"{x)+ 

[ {h{x + y)-h{x))iUiyidx) + 

/ {h{x + y)-h{x)-yh'{x)){Iliy{dx) 

where j{ , A( (dy) are respectively, the translation function, the vari- 
ance measure, and the Levy measure of the process on the flow / and 
(7/)', (A{)', (n(y{dy) denote the derivatives at s of these functions. The 
domain of Gi contains the dense subspace of twice continuously differ- 
entiable functions /i : R — > R such that h, h', h" are bounded. 

2. The generator of the empirical process of size n, corresponding to a proba- 
bility measure F which has the property that V/ € «S Fof is differentiable, 
is given by 

im = ,n- *) (h ('-±1) ^l^, k < „, 



nj J l-Fo/(s)' 

where [F o fy{s) denotes the derivative at s of o /. The domain of 
is the space of all flnite arrays h := (ft.(fc))fe=o....,n- 

3. The generator of the Dirichlet process with parameter measure a which 
has the property that V/ e «S a o / is differentiable, is given by 



{g{h){x) = {aofy{s) f 

Jo 



h{x + y)- h{x) fi-x- "(-^W")-! 

ay 



y V 1 



where (q o /)'(s) denotes the derivative at s of a o /. The domain of 
contains the dense subspace of continuously differentiable functions 
/i : R — » R such that h, h' are bounded. 



The goal is to find the conditions that have to be satisfied by the collection 
{G^ ■= {Gs )s',f € <S} of generators such that the associated collection {Q-^;f e 
<S} of one-parameter transition systems satisfies the matching Assumption 2 
and the consistency Assumption 3. By invoking Corollary 1, we will be able 
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to conclude next that there exists a set-indexed transition system Q and a Q- 
Markov process X := {XA)AeA with initial distribution fi, whose generator is 
exactly the collection {Q^ := {Gf}s', f £ S}. 

Using the integral equation (6), we will first give the equivalent form in terms 
of generators of the matching Assumption 2. 

Assumption 4. If ordl = {Aq = 0', ^i, . . . , An} and ord2 = {Aq = 0', A[, 

. . . , A'j^} are two consistent orderings of some finite semilattices A', A", such 
that ^jLiAj = U!^iA^-,U*^^iAj = Llj=iA'j for some k < n,l < m, and we 
denote f := fA',ordi, 9 ■= fA",ord2 with f{ti) = uj^iAj, g{ui) = uj^iA^, then 
for every h gV 

fti /'Ui ftn 

/ glT^t.hdv = / G'Ahdv and / GlT^.^hdv = / Gm^^hdv 

Jo Jo Jtk Jui 



We will need the following notational convention. 

If Qi(xi; dx2), Q2{x2\ dxii), . . . , (ix„) arc transition probabilities on 

R, Ti, T2, . . . , Tn-i are their associated bounded linear operators, and h : R" — *■ 
R is a bounded measurable function, then 

TiT2...Tn-l [h{xi,X2,...,Xn)]{xi) : = 
/ h{xi,X2, . . . ,Xn)Qn-l{Xn-i;dXn) ■ . . Q2{X2; dX3)Ql{xv, dX2) 

If in addition, is a linear operator on i3(R) with domain T>{G), and the 
function h is chosen such that for every xi,. . . ,Xk € R, the function 

/ h{xi,X2, Xn)Qn-l{Xn-i;dXn) ■ ■ ■ Qk+l{Xk+l\ dXk+2)Qk{-\ dXk+l) 

JH"-'' 

is in ^{G), then 

T1T2 . . .Tk-iGTk . . .T„_i [h(xi,X2,...,x„)]{xi) 

/ {G h{xi,X2, . . . ,Xn)Qn-l{Xn-i;dXn) . . .Qk+l{Xk+i;dXk+2) 

Qki-;dxk+i)){xk)Qk-iixk-i;dxk) ■ . .Q2{x2;dx3)Qi{xi;dx2). 

In order to understand the consistency Assumption 3 and to see how we can 
express it in terms of the generators, we consider a simple example. Let A' be a 
finite semilattice consisting of 6 sets, ordl = {Aq = 0', Ai, . . . , Ae} and ord2 = 
{Ao = 0', A[, . . . , Aq} two consistent orderings of A' with Ai = A^^.j, where tt 
is the permutation (1) (24) (36) (5). Denote with Ci,C- the left neighbourhoods 
of Ai respectively A[. 
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Ae 






A4 


A, 






Ai 


A2 


A3 





A'3 






A', 


A', 






A[ 


A', 


A' 

^6 





Set / := fA'.ordi, 9 ■■= fA',ord2 with f(ti) = U'j^iAj, g{ui) = Li]^-^A'j 
for i = 1,...,6. Suppose that a Q-Markov process {XA)AeA exists; denote 
X := Xf and Y := X^. We have 



Y Y V — V ■ Y — Y V — V ■ Y — Y V —V 



Y —Y 



Using these equahties we will first find the relationship between T/.__^^. and 
^/,(,)„i,«,(.) and then between the generators {gl)welu^i,u] and (^{?)t,e[«^(.)_i,«,(.)] 
for i = 2, . . . , 6. 

For i = 2 we have P[Xt^ - Xt, G r\Xt, = xi] = P[F„, - Y^^ e rlY^, = xi] 
which leads us to the equation: V/i G -B(R-) 



/ h{x2)Q{^t2i^i;dx2) = h{xi+yi-yi)Ql^^^{yi;dyi)Ql^^^{xi:, 
Jr Jr2 

Using the above notational convention, this can be written as 



(7) 



Let h e V and subtract h{xi) from both sides of this equation. Using (6) and 
Fubini's theorem, we get 



■t2 PU4 

{QiTl^h){xi)dw = / Tl^^Qin^, [h{x^ +yA- ys)]{x^)dv 

1 Ju^ 



(8) 



Note that (7) and (8) are equivalent (since V is dense in _B(R)). 



For i = 3, P[Xt, - Xt, e ri,Xt3 - Xt, e T2\Xt, = xi] = P[Yu, - r„3 g 

Fi, F„g — G F2|yui = xi] which leads us to the equation: V/ii, ft,2 G -B(R) 



(9) 



T'TluJlu^TluAMy^ - y3)h2{xi + y4 - + 2/6 - y5)]{xi) 
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Let hi,h2 eV and subtract T9^„^T9^„J/ii(y4 - yz)h2{xi + 2/4 - y3)](a;i) from 
both sides of this equation. On the left-hand side we get 

Jt2 

On the right-hand side we have 

^«i«3^4«4^«4«5 [i'ril,uef^'ixi,y3, y4, y5, •))(y5) - h{xi,y3, y4)](xi) 

with 2/3,^4, 2/5,2/6) := /ii(2/4-y3)/i2(a;i +2/4-^3+^6-^5) and 2/3, 2/4) = 
hi{y4 - yz)h2{xi + 2/4 - 2/3), which becomes 

/ Tl^Tl^Tl^.S'vT^ue [hiiVi - y3)h2{x, + 2/4 - ys + 2/6 - y5)]ixi) 
because h'{xi,y3,y4,y5,y5) = h{xi,yi,yi). 

Therefore, the equivalent form of (9) in terms of the generators is 

/*' n^u,n,uAh^{y4 - ysKGlTl^^h^Kx, + 2/4 - y3)]ix,) (10) 

= / Tl^,n,^Tl^MTL, [hi{yA - y3)h2{xi + 2/4 - y3 + y6 - y5)]{xi) 

Continuing in the same manner for i = 4 we will get the necessary rela- 
tionship between t/^^^ and T^^^^. (When we write down this relationship we 

have to specify the ordering of tt{2) - 1, 7r(2), 7r(3) - 1, 7r(3), 7r(4) - 1, 7r(4).) This 
relationship will have an equivalent form in terms of the generators {Gl,)we[t3,t4,] 
and {gv)vG[ui,u2]- 

At the end of this procedure we discover a collection of 5 necessary relation- 
ships that have to be satisfied by the generators G-^ and G^ of the process. A 
very important fact is that these relationships are also sufficient, i.e. if they 
hold then the finite dimensional distribution of the process over the semilattice 
A' is 'invariant' under the two orderings ordl and ord2. 

We return now to the general context. Let /i/^ be the probability measure 
defined by /x{^(r) := J^QQf.^{x;T)iJ.{dx). The following result is crucial and its 
non-trivial proof can be found in the appendix. 

Lemma 6. Let ordl = {Aq = , Ai, . . . , An} and ord2 = {Aq = 0',^^, 
. . . , A^} be two consistent orderings of the same finite semilattice A' with Ai = 
^7r(i)' ^^^''6 IT is a permutation of {l,...,n} with tt{1) = 1, and set f := 

f A', ordl, 9 ■■= fA',ord2 with f{ti) = U^j^iAj , g{Ui) = ^j=iA'y 

Suppose that Qq^^ = • following statements are equivalent: 
(a) the integral condition (5) of the consistency Assumption 3 holds; 
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(b) for each i = 2, . . . ,n, if we denote with h < h < ■ ■ ■ ^ the increasing 

ordering of the values 7r(2) — 1, 7r(2), 7r(3) — 1, 7r(3), . . . , 7r(i) — 1, 7r(i), and 
with p the index for which 7r(i) — 1 = Zp_i,7r(i) = Ip, then for every 

h2, ■ ■ ■ ,hi £ V and for ^{_^ -almost all Xi 

(bl) if p = 2{i — 1) we have 

rti 

/ rpg rpg rpg 

J ti — i 

i-1 i-1 
i—1 i 

[11 ^j^y^i) - y7v{j)-i)hi{xi + J2^ynij) - yn{j)-i))]{xi)dv; 

(b2) if p < 2{i — 1) we have 
I TB 

Jt -1 ' " "'f-3'"p-2 "'p-2"!p+l "'p+l"'p+2 ■ ■ "'2(4-1)-! "'2(i-l) 

i-1 i-1 



[11 l^^^y^U) - y<j)-i)iSiTlt.hi){xi + ^{y^(j) - y„^j)-i))]{xi)dw 
= / Tf G^T^ 

"'"ip-1 

i-1 

^»'p»'p+i^»'p+i"ip+2 ■ ■ ■■^«'2(i-i)-i»'2(i-i) ^j^y^o) - y7rO)-i)- 

J=2 

i i — 1 

[hi{xi + J2(y<j) - y<j)-i)) - f^ii^i + ^iy<j) - 



3=2 3=2 



The following assumption is the equivalent form in terms of generators of 
the consistency Assumption 3. 

Assumption 5. If ordl = {Aq = 0', Ai, . . . , An} and ord2 = {Aq = 0', A[, 

. . . , A'j^} are two consistent orderings of the same finite semilattice A' with Ai = 
A'^i^^y where n is a permutation o/ {!,..., n} with 7r(l) = 1, and we denote 

f ■■= fA',ordi, g ■■= fA',ord2 with f {ti) = U)=iAj, g{ui) = Uj^iA'^, then the 
generators and satisfy condition (h) stated in Lemma 6. 
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Clearly Assumptions 4 and 5 are necessary conditions satisfied by the gener- 
ator of any set-indexed Q-Markov process. The following result is an immediate 
consequence of Corollary 1 which says that in fact, these two assumptions are 
also sufficient for the construction of the process. 

Theorem 2. Let n be a probability measure on R and {Q-^ := {Gs)st / G 
a collection of families of linear operators on B(R) such that each operator 

QI is defined on a dense subspace T) of i?(R) and is the generator at time 
s of a semigroup := [Tf^jg^t associated with a transition system Qj := 
{Qit)s<t- If the family {G^;f G S} satisfies the matching Assumption 4 and 
the consistency Assumption 5, then there exist a set-indexed transition system 
Q '■= {Qbb')b,b'£A{u);Bcb' and a Q- Markov process X := {XA)AeA with initial 
distribution n, whose generator is exactly the collection {Ql ; f G S}. 

Acknowledgement. The authors greatly appreciate the thoughtful comments and sugges- 
tions of Professor Donald. A. Dawson regarding the use of the integral equation (6) for proving 
the equivalence of statements (a) and (b) in Lemma 6. 



A Proof of Lemma 6 

We will prove the desired equivalence by means of an intermediate condition 
(b'). We will show that (a) <^ (b') and (b') <^ (b). Here is this condition. 

(b') For each i = 2,...,n, if we denote with h < h < ■■■ < hii-i) the 
increasing ordering of the values 7r(2) — 1, 7r(2), 7r(3) — 1, 7r(3), . . . , 7r(i) — 1, 7r(i), 
and with p the index for which 7r(i) — 1 = lp-i,Tr{i) = Ip, then for every 
h2,. ■ . ,hi e B(R) and for -almost all xi 

fg rrg 'vg j^g j^g 'rg /-i i \ 

UlUii Ul^Ul^--- «!p_3«ip_2 «ip-2«ip+l '"p+l"'p+2 ■ ■ "'2(i-l)-l«'2(i-l) ^ ' 

i-1 i-1 

[11 ^liyTrU) - y^(3)-i){Tl_^t^hi){xi + J2^y<j) ~ y^u)-iM^^) 

— T^s 7^3 rpg 

«il«i2 ■ ■ ■ «'2(i-l)-l"i2(i-l) 

i-1 i 

Proof of (a) ^ (b'): Let X be a Q-'^-Markov process and Y a Q^-Markov 
process with the same initial distribution /j,. Since Qoti = Qom > both Xt^ and 

have the same distribution /i/^ . The integral condition (5) of the consistency 
Assumption 6 is equivalent to saying that for fi( -almost all .xi, the conditional 
distribution of {Xt^ — Xt^, . . . ,Xt^ — Xt^_^) given Xt^ = xi coincide with the 
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conditional distribution of {Yu^^^^ - Yu^^^^_^ Y^^^^^ - Yu^^^^_J given Y^^ = 

For i = 2 we will use the following relationship: for every r2 S 'B(R) and for 

/x/^-almost all xi 

p[Xt, - G T^\Xt, = xi] = p[y„,(,, - y„,(„_, e r2|y„, = xi] 

Using the Markov property, the left-hand side is Jp^7r2+xi(:c2)<3tit2(a;i;(ia;2), 
whereas on the right-hand side we have 



By a monotone class argument we can conclude that for every /i2 G S(R) and 
for /Lt/^ -almost all xi 

/ h2{x2)Q{,t2{xi;dx2) ^ ^2(a;i -|-?/„,(2) -yu,(2)-i) (12) 
Jb. Jr2 

<3L(2)-l«.(2) (?/7r(2)-i; C?2/,r(2))Q^i„,(2)_i (^^l I c;y^(2)-l) 

which is the desired relationship for i = 2. 

For i = 3 we will use the following relationship: for every G B{Il) and 

for /if^ -almost all xi 

P[Xt, - Xt, e T2,Xt, - Xt, e r^lXt^ = xi] = 

-^[^7r(2) ~ ^7r(2)-l ^ ■'^2)^„(3) ~ ^„(3)-l ^ ^311^^ = Xl] 

The left-hand side can be written as 



/R2 

which becomes 



/ Ir2+xi (x2)/r3+cc2 ix3)Qit3 (2^2; dx3)Qit2 i^i ' dx^) 



/ -fr2(2/7r(2) -y7r(2)-i)-?"r3+xi-i-!/,(2)-j/,(2)-i(a^3)<34t3(^i +2/t(2) -y7r(2)-i;rfa;3) 

JR3 

*3u,(2)_i«,(2) (2/7r(2)-i; rf2/^(2))^<3^i„,(„_i (a;i; d?/„(2)-i) 

using equation (12). 

The right-hand side can be written as 



/R* 



Ir2iy^(2) -2/7r(2)-i)7r3(j/^(3) - yn(3)-i)Ql,^,u,Syh;dyi^)Qi^^ .^^_^{yi^;dyi^) 

Qii, ,ui2 (^'i ; '^^/is )<3«i ; c??/ii ) 
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where h < h < h < h is the increasing ordering of the values 7r(2) — 1, 7r(2), 7r(3) 
-l,7r(3). 

By a monotone class argument we can conclude that for every h2,hs G -B(R) 
and for /x/^ -almost all Xi 

/ h2{y„(2) - yni2)-l)h3{X3)Qits {Xl + yn{2) " 2/7r(2)-i; £^2:3) (13) 
= / ^2(y,r(2)-y7r(2)-l)/i3(a;i+y,r(2)-y7r(2)-l+2/7r(3)-y7r(3)-l)<3?l,,,„,,(yi3;'^yi4) 

Q«!2 ,"(3 

which is the desired relationship for i = 3. 

The inductive argument will be omitted since it is identical, but notationally 
complex. 

Proof of (b') (a): Let Tq, Ti, . . . , r„ g B(R) be arbitrary. Using the fact 
that Qqj^ = Qqui ^iid equation (12), the left-hand side of the integral condition 

(5) becomes 

/ ^ro(yo)/ri(2/l)/r2(y7r(2) - yn{2)-l)lTs+yi+v^i2)-y^(2)-iiX3)lT^+X3{X4) ■ ■ ■ 

{xs; dx4)Q{^t3 {yi+y7^(2)-y^(2)~i;dx3) 
QL(2)-iu^(2) (yvr(2)-i; rfy7r(2))OSi„^(,)_i (yi; dy^^2)-i)Qom (yo; dyi)fj,{dyo) 

which in turn can be written as 

lTo{yo)Iri{yi)Ir2{y-ni2) - yn{2)-l)Ir3{yn{3) - yn{3)-l) 

^r.+,i+^^ -..0,-1) • • • Ir^+^.-iMQi_,tAxn-i;dXr,) . . . 

3 

QLAv^ + Y.'^y^u) - y^ro)-!); dx4)Qi,^^^,^ {yh-^dyi^)Qli^,ui^ (yh^dyis) 
Qii„ui2 iyh'dyi2)Qlr,ui, {yi;dyiMu, (yo; dyx)n{dyQ) 

using equation (13), whore Zi < ^2 < ^3 < Ia is the increasing ordering of the 
values 7r(2) - 1, 7r(2), 7r(3) - l,7r(3). 

Continuing in the same manner at the last step we will get exactly the 
desired right-hand side of equation (5), since the increasing ordering of the 
values 7r(2) — 1, 7r(2), . . . , 7r(n) — 1, 7r(n) is exactly 1 < 2 < . . . < n. 

Proof of (b') ^ (b): The basic ingredient will be equation (6), which gives 
the integral expression of a semigroup in terms of its generator. 
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Since T> is dense we can assume that the functions h2,. . ■ ,hi are in V in the 
expression given by (b'). Subtract 

tiljUij--- M!j,_3«ip_2 M!j,_2«ip + 1 "ip + 1 «!p+2 ' " ' «'2(i-l) - 1 ^"2(4-1) 

from both sides of this expression. 
On the left-hand side wc will have 

7^s T^s T^s T^s 7^9 7^9 

«'l"i2 ■ ■ »!p-3"ip-2 »!p-2"ip+l '"p+l"'p+2 " " "'2(4-1) - 1 "'2(4-1) 

i-1 i-1 

which can be written as 

/ 7^9 7^9 7^9 7^9 7^9 7^9 

J^^^ UlUii «ii«i2--- "!p-3«!p-2 «!p-2"Wl «!p+l»!p+2 ' " ' "'2(4-1) - 1 «'2(i- 1) 

i-1 i-1 
3=2 3=2 

using the integral expression (6) and Fubini's theorem. 
On the right-hand side we have 

7~'9 719 719 7^9 

"l«'l "!l"i2 ■ ■ «Ip-3"ip-2 «'p-2«'p-l 

1719 7^9 7^9 7^9 

>• "ip-1 "ip "!p"ip+l "ip+1 "ip+2 • ■ «'2(i-l)-l "'2(4-1) 

i—1 i 

XI ^i^y^u) - ynu)-i)hiixi + J2^y^u) ~ y^{3)-iMyip-i)- 



3=2 j=2 

"'p-l"'p + l "'p + l«ip+2 ■ ■ ■ "'2(4-l)-l"'2(i-l) 

i-1 i-1 

[11 ^j(y'rO) ~ yTO)-i)/ii(a;i + YivwU) - yw{3)-i))]{yi^-i)}{xi) 

3=2 j=2 

If we denote 

h'{xi,yi,,...,yi^_^,yi^) := 

. i— 1 i 

/ n ^j^y^J) - 2/7r(i)-i)/Ji(a;i + J2^y^U) ~ y<3)-^)) 

7r2(4-1)-p .^^ .^^ 
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and 

h{xi,yi,,...,yi^_J := 

P i— 1 i— 1 

/ n ^i^y-^d) - yn{j)-i)hi{xi + ^{y^{j) - yn{j)-i)) 

then the right-hand side becomes 



7^9 719 7^9 7^9 

f^'i^i^Vh ' • • • ' y'p-i ' •))(yip-i) - Hxi,yii vi^-Mxi) 
— 7^9 7^9 7^9 7^9 

[h'{xi,yi^,. . . , yi^_^,yi^_^) - h{xi,yi^,. . .,yi^_^)+ 
+ / {G',Ts^,h'{xuyi,,. . ■,yi,-r,-)){yi,-r)dv]{xi) 

since h'{xi ,yi^,..., yi^_^ , ■) € ^ for every xi,yi^,..., yi^_i. We have two cases: 
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Case 1) li p = 2{i — 1), then all the integrals with respect to Q 
Q?, , , Q£ „ disappear in the preceding expressions. Hence 

^"'p+l"'p + 2' "'2(i-l)-l "'2(i-l) o I 

h'{xi,yi,,. . ■ ,yi^_i,yip_i) = h{xi,yi^,. . .,yi^_^) and the result follows. 
Case 2) If j5 < 2{i - 1), then 

h'{xi,yi^,. . .,yi^_^,yi^_,) = {T^^^^^^^^H{xi,yi^, . ■ ■ ,yip-i,-))iyip-i) 
h{xi,yi„..., yi^_J = {Tl^_^ ^(^i ,yh,---, Vip-i , ■)){yip-i ) 

where 

H{xi,yi^,...,yi^_,,yi^_^_J ■= 

I n ^i'<yA3) - y^u)-i)hi{xi + J^^y^j) - y^j)-^)) 
^"'2(.-i)-i«'2(.-i, ^y^Hi-i)-^''^y^Hi-i)) ■ ■ - Qit^^.u,^^, iyip+i;dyi,+,) 
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To simplify the notation we will omit the arguments of the function H. 
Hence 

h'{xi,yi^,. . . , yi^_,,yi^_,) - h{xi,yi,,. . . , yi^_,) 



= iTl^u,^,H){yt^_,) - [Tl^_^^,^{Tl^^^^^H)]{yt^_,) 



since H{xi,yi^, . . . , yi^_^ , ■) e for every xi,yi^,..., yi^_^. 
Using Fubini's theorem, the right-hand side becomes 



W!i«i2""" "!p_3"V-2 "!p-2«'p-l 



'p — 1 

[{Qinu,U{xi,yi,,. . .,yi,.,,-)){yi,.Mxi)dv 

where 

U{xi,yi,,...,yi^_,,yi^) := 
= h'{xi,yi,,..., yi^_-^, yi^ ) - {T^^^^^^^^H{xi ,yi,,yi^, . . . , yi^_,, ■)){yij 

i-1 



/ Y[hj{y„(^j) -y„(^j)_i) 



i i—1 

This concludes the proof. □ 
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